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1. This document has been translated by computer. So the transla:tion may not reflect the 
original precisely. 

2 **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The white balance amendment approach which is the white balance amendment 
approach which amends the photography image data which photoed the photographic 
subject under the predetermined source of the illumination hght, and was obtained with a 
predetermined white balance correction factor, and is characterized by to perform color 
correction of said photography image data by [ of said photographic subject 1 computing 
said white balance correction factor using brightness information absolutely, and changing 
extent of white balance amendment of said photography image data using the chromaticity 
information on this white balance correction factor and said source of the illumination 
hght. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the white balance amendment approach 
at the time of photping a photographic subject image, and relates to the white balance 
amendment approach of a photographic subject of performing white balance amendment 
appropriately using a brightness value and the chromaticity value of the source of the 
illumination light absolutely, especially. 
[0002] 

[Description of the Prior Art] In the color reproduction of a photograph or a video image, 
the color of the light source which is illuminating the photographic subject has had big 
effect on the color reproduction of a reappearance image. For example, the hght which 
comes from the photographic subject illuminated with the tungsten lamp contains much 
redness, and when the image which photoed the photographic subject illuminated with the 
tungsten lamp is reproduced by the same technique as the image photoed under the usual 
daylight, it will bend with the image which redness cut very much. That is, although the 
Ught which comes from a photographic subject has actually changed, if the light quality of 
the source of the illumination light is reproduced as fixed, the tint of the source of the 
illumination hght wiU be reflected in a direct reappearance image, and it will look 
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unnaturally to human being's eyes. 

[0003] The homeostasis of human being's eyes is mentioned as the cause. That is, even 
when the class of light source changes, there is work which adjusts the sensibiUty balance 
of a visual cell, and it is called the homeostasis of a color to human being's eyes so that 
color change of a photographic subject may be made into min. For example, under the 
strong light source of redness like a tungsten lamp, human being's eyes lower the 
sensibility of the cell sensed for the red in a retina, and have the work under the usual 
source of the white light which it is visible and carries out abbreviation coincidence the 
direction. 

[0004] Therefore, in order to reproduce a photograph and a video image so that the color 
may look natural to human being's eyes, it is necessary to copy work of the 
above-mentioned human being's eyes. Then, the function imitating such a function is 
already mounted in many image acquisition equipments. For example, there is work which 
adjusts the balance of RGB of the captured image in the case of a CCD camera, and adjusts 
the color of an image, and since this is generally adjusted so that the white in an image 
may always be reproduced as white, it is called white balance adjustment (white balance 
amendment). Moreover, it is possible to work by white balance amendment, abbreviation, 
etc. being by carrying out also about the image photoed by the negative color film by 
adjusting the tint of the print light at the time of creating a color print. 
[0005] By the way, it sets to the conventional white balance amendment approach. Since 
he was trying to adjust a white balance correction factor generally so that a white 
photographic subject may be reproduced by perfect white. For example, when a 
photographic subject was photoed under the scenery compared with the setting sun, and 
the light of a candle, after performing white balance amendment completely depending on 
the case, amendment might become superfluous and the conversely unnatural impression 
might be given. Then, he sets up a white balance correction factor more smallish partly 
intentionally, and was trying to reappear conventionally, in such a case, so that it may 
leave the tint of the illumination light slightly. 
[0006] 

iProblemCs) to be Solved by the Invention] However, in order to prevent a reappearance 
image becoming unnatural like said before, when setting up a white balance correction 
factor more smallish intentionally, it was not clear as how much a white balance correction 
factor should have been set. Consequently, it is not being based on the intensity level of a 
photographic subject, but fixing extent of white balance amendment beforehand in most 
cases, and there was a problem that it might become a too unnatural image depending on 
the case. 

[0007] This invention makes it a technical problem to offer the white balance amendment 
approach that a near faithful color reproduction image can be obtained, when it is made in 
view of said conventional problem, a suitable white balance correction factor is determined 
to the photographic subject currently illuminated by the lighting of arbitration and human 
being observes a photographic subject. 
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[0008] 

[Means for Solving the Problem] In order to solve said technical problem, this invention the 
photography image data which photoed the photographic subject under the predetermined 
source of the illumination light, and was obtained It is the white balance amendment 
approach amended with a predetermined white balance correction factor. Said white 
balance correction factor is computed using the absolute brightness information of said 
photographic subject. The white balance amendment approach characterized by 
performing color correction of said photography image data is offered by changing extent of 
white balance amendment of said photography image data using the chromaticity 
information on this white balance correction factor and said source of the illumination light. 
[0009] Moreover, the thing of said photographic subject for which extent of said white 
balance amendment is enlarged is so desirable that a brightness value is large absolutely. 
[0010] moreover, the time offsetting Cw and the photographic subject absolute brightness 
value of said photographic subject to Z for a white balance correction factor " said white 
balance correction factor Cw a degree type - Cw =0.133 " log (Z) It is desirable to 
determine extent of said white balance amendment so that it may be contained in range 
which fills +0.667**0.1. 

[0011] Said white balance amendment approach Moreover, a means of said photographic 
subject to acquire brightness information absolutely, A means to compute a white balance 
correction factor from this absolute brightness information, and a means to acquire the 
chromaticity information on said source of the illumination light. By changing extent of 
white balance amendment of said photography image data using the chromaticity 
information on said white balance correction factor and said source of the illumination 
light, it performs with the white balance compensator characterized by having a means to 
perform color correction of said photography image data. 

[0012] Moreover, the thing of said photographic subject which a means to perform color 
correction of said photography image data was made to enlarge extent of said white 
balance amendment, so that the brightness value was large absolutely is desirable. 
[0013] moreover, a means to perform color correction of said photography image data -* 
said white balance correction factor Cw a photographic subject absolute brightness value *• 
Z - carrying out - a degree type - Cw =0.133 " log (Z) It is desirable to have determined 
extent of said white balance amendment so that it may be contained in the range of 
+0.667**0.1. 

[0014] Moreover, said white balance amendment approach is constructed as a software 
program for performing a computer, and it is desirable that this was made to perform said 
white balance amendment approach. 
[0015] 

[Embodiment of the Invention] Hereafter, the white balance amendment approach of this 
invention is explained to a detail based on the suitable operation gestalt shown in an 
attached drawing. 

[0016] Drawing 1 is the block diagram showing the outline configuration of the white 
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balance compensator which performs the white balance amendment approach concerning 
this invention: As shown in drawing 1 . the white balance compensator 10 inputs the 
photography image data which photoed the photographic subject 14 illuminated by the 
source 12 of the illumination light with the image photography means 16, and was 
obtained, performs predetermined color correction (image transformation) processing, and 
outputs it as reappearance image data 18, 

[0017] The white balance compensator 10 in this operation gestalt has the information 
acquisition means 22, the photographic subject absolute brightness value acquisition 
means 24, the white balance correction factor calculation means 26, and the color 
correction means 28 whenever [ memory 20 and self-luminous color ], and is constituted. 
[0018] Memory 20 stores the photography image data inputted from the image 
photography means 16. The information acquisition means 22 acquires the chromaticity 
information on the source 12 of the illumination light which illuminates a photographic 
subject 14 (self-luminous color temperature) whenever [ self-luminous color 1. The 
photographic subject absolute brightness value acquisition means 24 is a thing of a 
photographic subject which acquires a brightness value (absolutely brightness 
information) absolutely. The white balance correction factor calculation means 26 is a 
thing of a photographic subject which computes a white balance correction factor from 
brightness information absolutely. Moreover, changing extent of white balance 
amendment using the white balance correction factor computed in the top and the 
chromaticity value of a photographic subject 14, and the chromaticity value of the source 
12 of the illumination light, it performs color correction to the inputted photography image 
data, and the color correction means 28 computes the chromaticity value of the 
reappearance image data 18. 

[0019] The white balance amendment approach concerning this invention hereafter 
performed by the white balance compensator 10 of this operation gestalt constituted in this 
way is explained. The flow of processing of the white balance amendment approach of this 
invention is shown in drawing 2 . 

[0020] First, in step 100 of drawing 2 , the photographic subject 14 illuminated by the 
source 12 of the illumination light is photoed with the image photography means 16. The 
photography image data acquired by the image photography means 16 is stored in memory 
20. Next, in step 110, the chromaticity information on the source 12 of the illumination 
Ught which illuminates a photographic subject 14 with the information acquisition means 
22 is acquired whenever [ self-luminous color ]. The information acquisition means 22 
acquires [ whenever / self-luminous color ] information for photography image data from 
memory 20 whenever [ self-luminous color ] reception and after this. 

[0021] Although especially the approach of acquiring information whenever [ self-luminous 
color ] is not limited, the easiest approach puts in the body (for example^ the gray version of 
18% of reflection factors) of reflection factor known for example, into the photographic 
subject, and is searched for by measuring the distribution of Ught reflected from there. 
Measurement of distribution of this Ught is the data Rg of that part out of the photography 
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image data which photoed the photographic subject 14 with the image photography means 
16 (for example, the gray version of 18% of reflection factors), Gg, and Bg. What is 
necessary is just to make it sample. However, on general photography conditions, such an 
approach may necessarily be unable to be taken and, in such a case, the chromaticity 
information on the light source is presumed from the acquired photography image data 
(image information). As an approach of presuming the chromaticity information on the 
light source from the picture signal acquired under such predetermined photography 
conditions, there is a;n approach proposed by these people in JP,8-122157,A, for example. 
[0022] Next, in step 120, the absolute brightness information (absolutely the brightness 
value Z) of a photographic subject 14 is acquired with the photographic subject absolute 
brightness value acquisition means 26. The photographic subject brightness said here 
means the overall brightness of a photographic subject. Moreover, absolutely, the 
brightness value Z should just measure the absolute brightness value Z of the gray version 
of 18% of this reflection factor with a luminance meter etc., when [ of a photographic 
subject 14 ] putting in and photoing the body (for example, the gray version of 18% of 
reflection factors) of reflection factor known in a photographic subject, as mentioned above. 
[0023] Thus, by measurement by the luminance meter, although the brightness value Z 
can be acquired absolutely, brightness information may be attached to photography image 
data, and, on the other hand, the technique of from now on acquiring the brightness value 
Z absolutely by the image processing may be used like [ in the case of taking a photograph 
with a digital camera of a photographic subject 14 ], so that the information on brightness, 
such as an exposure value, may be added to photography image data as an EXIF format. 
[0024] Next, it sets to step 130 and a photographic subject 14 is the white balance 
correction factor Cw from brightness information absolutely with the white balance 
correction factor calculation means 26. It computes. White balance correction factor Cw 
Although not hmited, as for especially the way of determining, it is desirable to go into the 
range given by the following formula (l). 
Cw =0.133xlog(Z) +0.667**0.1 ... (1) 

It is the white balance correction factor Cw so that it may be contained in the range of the 
value decided by this formula (l). The following formula (2) is illustrated as one formula to 
compute! 
[Equation l] 

[0025] Next, white balance correction factor Cw computed in the color correction means 28 
at step 140 the chromaticity value of a photographic subject 14, the chromaticity value of 
the source 12 of the illumination light, and now The chromaticity value of a reappearance 
image is computed by using, and the reappearance image data 18 is outputted. First, they 
are Information Rg, Gg, and Bg whenever [ self-luminous color / which was acquired in the 
top ]. It changes using the function F (alpha) defined by the following formula (3). 
[Equation 2] 
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[0026] Namely, Rg, Gg, and Bg With this function F (alpha), it changes with Rgl=F (Rg), 
Ggl=F (Gg). and Bgl=F (Bg). These changed data Rgl, Ggl, and Bgl are changed into the 
LMS value which is the same amount as the visual ceU of human being's retina wins 
popularity. This conversion is performed by the following formula (^. 
[Equation Sl . 

[0027] Moreover, the chromaticity coordinate xm of the gray version of 18% of reflection 
factors in the photography image data which photoed the photographic subject 14 and was 
obtained and ym It changes into said LMS value by the following formula (5). 
[Equation 4] 



[0028] Moreover, the function F (alpha) once defined by said formula (3) on the other hand 
in the RGB data of each point of the photography image data photoed with the image 
photography means 16 is used, and they are Data Rl, Gl, and Bl. After changing It changes 
into said LMS value by the following formula (6)., 
[Equations] 

[0029] Next, Lg computed in the top, Mg, and Sg And Lm, Mm, and Sm And said white 
balance correction factor Cw It uses and color correction is performed to the image data 
now changed into the LMS value by the foUowing formula (7). 
[Equation 6] 



[0030] It sets at this ceremony (7), for example, is the white balance multipUer Cw. When 1, 
L' is L'=(Lm/Lg) L. It becomes. The data Lg of the part which is equivalent to the body (the 
gray version of 18% of reflection factors) of reflection factor known as L here, Mg, and Sg 
An input outputs the LMS value (Lm, Mm, and Sm) changed from the chromaticity of this 
body. Moreover, it sets at a ceremony (7) and is the white balance correction factor Cw. If 0, 
L' will be set to L'=L and will become the inputted value itself. Therefore, nothing wiU be 
changed, namely, the data influenced of the source 12 of the illumination Ught -- it remains 
as it is - ****** is carried out. . 

[0031] After aU. they are Lg, Mg. and Sg by the formula (7). And Lm, Mm. and Sm Extent 
of white balance amendment will be changed with a value. Thus, at this operation gestalt, 
it is only the white balance correction factor Cw to the value LMS of photography image 
data. It hangs, white balance amendment is performed, and output-value L'M'S' is not 
computed, but he carries out like a formula (7), and is trying to change extent of white 
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[0032] And data L*M'S' which is carried out in this way and by which white balance 
amendment was performed to the last is changed into a RGB value (Rl, Gl, and Bl) by the 
following formula (8). [Equation 7] 

[0033] Moreover, this data Rl, Gl, and Bl It changes using inverse function F-1 (alpha) of 
said function F (alpha) defined by the following formula (9). 
[Equation 8] 

[0034] That is, it changes with R'=F-l(Rl) G'=F1 (GO, B' =F-1 (Bl). it is outputted as 
reappearance image data 18 (R', G', and B - 0 to which color correction was finaUy 
performed by this. Thus, the R'G'B' image data which performed white balance 
amendment appropriately can be obtained to the RGB image data acquired by the image 
photography means 16. 

[0035] Hereafter, a more concrete example is explained. 

(Example l) It is the digital camera FinePix470a by Fuji Photo Film Co., Ltd. about the 
photographic subject illuminated now, using a tungsten color fluorescent lamp as a source 
of the illumination light. A photograph was used and taken. In addition, this digital 
camera was adjusted so that the RGB value outputted when gray is photoed under the 
light source of about 5500 color temperature K (xm =0.3324, ym =0.3474) might gather. 
Moreover, the gray version of 18% of reflection factors is put in into the photographic 
subject, and they are the data Rg of the gray version, Gg, and Bg from the photography 
image data of the part. It sampled. 

[0036] moreover, said gray version - absolutely - the brightness value Z (cd/m2) " the 
Minolta Co., Ltd, make " it measured by color color difference meter OS- 1000. This 
absolute brightness value Z is used and it is the white balance correction factor Cw by said 
formula (2). It computed. 

[0037] Moreover, the photography image data Rg of the part of said gray version, Gg, and 
Bg Once changing into Rgl, Ggl, and a Bgl value using the function F (alpha) defined by 
said formula (3) It changed into the LMS value (Lg, Mg, Sg) which is the same amount as 
the visual cell of human being's retina receives by said formula (4)., moreover, the 
chromaticity value xm of this photography image data and ym firom - by said formula (5), 
the LMS value (Lm, Mm, and Sm) over a chromaticity value (xm and ym) was computed. 
[0038] Moreover, they are once Rl, Gl, and Bl by Function F (alpha) similarly about the 
RGB data of each point of the photography image data which photoed the photographic 
subject and was obtained with the digital camera. After changing into a value, it changed 
into the LMS value (L, M, S) hy said formula (6). the image data changed into this LMS 
value receiving - said formula white balance correction factor Cw And Lg, Mg, and Sg 
And Lm, Mm, and Sm using " said - a formula - (" seven -) " a white balance - 
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amendment - extent - changing - color correction - carrying out - L - ' " M " * " S - ' - a 
value " having computed . 

[0039] the last - this - L - » - M - ' " S ' " a value - said - a formula - (- eight -) - 
RGB a value (Rl, Gl, and BO - changing - this - data " Rl - Gl - Bl " said - a formula - 
nine -) " giving a definition " having - a function - F-1 (alpha) - using - data - R " ' " 
Q t g I - changing " reappearance image data " having obtained . The R'G'B* image 
which performed white balance amendment appropriately to the RGB image acquired with 
the digitar camera was able to be obtained by performing color correction with such a 
procedure. 

[0040] Next, other concrete examples are explained. 

(Example 2) Lighting reinforcement prepared the observation booth equipped with the 
adjustable tungsten color fluorescent lamp, installed the color checker made firom Gretag 
Macbeth in this, and made this the criteria photographic subject. 

[0041] Lighting reinforcement is adjusted so that the brightness of said color checker's 
22nd gray may be set to 3, 10, and 31,100 (cd/m2), reispectively, and it sets on each lighting 
conditions, and is the digital camera FinePix4700 by Fuji Photo Film Co., Ltd. about a 
criteria photographic subject. A photograph was used and taken. In addition, this digital 
camera was adjusted so that the RGB value outputted when gray is photoed under the 
light so\u-ce of about 5500 color temperature K (xm =0.3324, ym =0.3474) might gather. 
[0042] Thus, thie photography image data Rg of the photoed image of four sheets to each 
22nd gray, Gg, and Bg It sampled. In addition, although the computational procedure 
about one image is explained below, the count technique is common about each image of 
four sheets. First, the photography image data Rg of the 22nd gray, Gg, and Bg They are 
Lg, Mg, and Sg like the upper example by said formula (4) after changing into Data Rgl, 
Ggl, and Bgl with Function F (alpha). It changed into the value. Moreover, they are Lm, 
Mm, and Sm by said formula (5) about the chromaticity value (xm and ym) of the gray 
plate under the 5500K Ught source. It changed into the value. 

[0043] Moreover, they are Data Rl, Gl, and Bl by Function F (alpha) like [ the RGB image 
data of each point of the image data photoed with the digital camera ] a top. After changing, 
it changed into the LMS value by said formula (6). moreover, white balance correction 
factor Cw as a value - Cw =0.5, 0.6, 0.7, 0.8, and 0. - six kinds of values of 9 and 1.0 were 
adopted. Namely, white balance correction factor Cw of these six pieces The reappearance 
image of six sheets was created from the photography image to one lighting condition by 
using and performing color correction. 

[0044] Namely, this white balance correction factor Cw The value Lg calculated in the top, 
Mg, and Sg Lm, Mm, and Sm It used and said formula (7) performed color correction to the 
L'M'S' value from the LMS value, and - the last - color correction - carrying out - having 
had - UM'S - ' - a value - said - a formula - (- eight -) - RGB data - Rl - Gl - Bl - 
changing - this - a function F-1 (alpha) " using - final " RGB data - R - * - G " ' " B 
• " changing *" reappearance image data having carried out . The printed output of this 
reappearance image data R'G'B' was carried out by Pictrography3000 by Fuji Photo Film 



8/10 



Japanese Publication number : 2003-259392 A 



Co., Ltd., and the print of six sheets was obtained for every lighting conditions as a result. 
[0045] The criteria photographic subject of each lighting conditions was observed, the 
vanity was memorized, the print of six sheets to each lighting conditions of corresponding 
was observed under the fluorescent lamp of color temperature 5500K, respectively, and the 
organic-functions evaluation experiment which judges how close [ to the vanity of a criteria 
photographic subject ] each print is was conducted. Observation was performed by five 
color vision normal persons engaged in color image evaluation since every day, and 
equaUzed the result, decision - O ... a criteria photographic subject almost the same -■ 
** ... a little different x fi-om a criteria photographic subject ... it carried out in the 
three-stage of different ** from a criteria photographic subject. An evaluation result is 
shown in the next table 1. 
[Table ll 

[0046] It is necessary to make extent (value of the white balance correction factor Cw) of 
white balance amendment so large that the brightness (cd/m2) of a photographic subject 
become high so that the evaluation result shown in Table 1 may show. That is, a better 
result is obtained by [ of a photographic subject ] enlarging extent of white balance 
amendment, so that a brightness value is large absolutely. Specifically, it is the white 
balance correction factor Cw. As for a value, it is desirable to go into the range of the value 
defined by said formula (l). 

[0047] As explained to the detail above, according to this operation gestalt, the absolute 
brightness value of a photographic subject is used, and it is the white balance correction 
factor Cw. Since extent of white balance amendment was changed using the chromaticity 
information on the source of the illumination Ught, and the chromaticity information on a 
photographic subject when computing and performing color correction of photography 
image data using this white balance correction factor, it became possible to perform 
appropriately white balance amendment corresponding to human being*s appearance. 
[0048] As mentioned above, although the white balance amendment approach of this 
invention was explained to the detail, as for this invention, in the range which is not 
limited to the above operation gestalt and does not deviate from the summary of this 
invention, it is needless to say that various kinds of amelioration and modification may be 
made. 
[0049] 

[Effect of the Invention] When human being observes a photographic subject, according to 
this invention, it becomes possible absolutely using brightness information and the 
chromaticity information on the source of the illumination light to obtain a near faithful 
color reproduction image by [ of a photographic subject ] changing extent of white balance 
amendment appropriately to the photographic subject currently illuminated by the 
fighting of arbitration, as explained above. 
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[Brief Description of the Drawings] 

[Drawing l] It is the block diagram showing the outline configuration of the white balance 
compensator which performs the white balance amendment approach concerning this 
invention. 

[Drawing 2l It is the flow chart which shows the flow of processing of the white balance 
amendment approach. 

[Description of Notations] ' 

10 White Balance Compensator 

12 Source of Illumination Light 

14 Photographic Subject 

16 Image Photography Means 

18 Reappearance Image Data 

20 Memory 

22 It is Information Acquisition Means whenever [ Self-luminous Color ]. 
24 Photographic Subject Absolute Brightness Value Acquisition Means 
26 White Balance Correction Factor Calculation Means 
28 Color Correction Means 
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